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ABSTRACT 

The  research  reported  deals  with  the  control  of  nonlinear  systems.  Among  the  topics  covered  are: 
State-space  emd  I/O  stabilization,  systems  with  saturated  controls,  universal  formulas  for  Lyapunov- 
function  based  feedb£ick,  neural-net  controllers,  discrete-time  controllabihty  and  sampled  control,  in¬ 
put/output  algebraic-differential  equations,  and  certain  types  of  Hamiltonian  systems. 


1  Introduction 

A  striking  amount  of  progress  was  achieved  during  the  past  few  years  on  difficult  questions  in  nonlinear 
control  theory.  First-rate  researchers  have  directed  their  efforts  towards  the  identification  of  differences 
with  the  well  derstood  linear  case  as  well  as  the  introduction  of  new  techniques.  The  recent  books  by 
Isidori  eind  Van  'jr  Schaft/Nijmejer  deal  exclusively  with  the  recent  developments.  The  Pi’s  gre^luate 
mathematics  textbook  [1]  mentions  briefly  some  of  these  topics  in  the  context  of  more  classical  linear 
results.  Another  new  book,  by  Slotine  and  Li,  Includes  an  excellent  exposition  of  various  applied  aspects. 
As  emphasized  in  Slotine-Li’s  book,  the  current  interest  in  nonlinear  techniques  by  researchers  in  areas  as 
diverse  as  robotics,  aerospace,  and  process  control,  is  based  on  the  availability  of  powerful  new  tools  for 
global  analysis  and  design,  which  provide  major  improvements  in  simplicity,  robustness,  and  operating 
range  over  more  classical  linear  approaches.  That  book  shows  with  detailed  and  realistic  examples  the 
applicability  of  the  nonlinear  theory. 

The  main  objective  of  control  theory  is  to  modify  the  behavior  of  a  dynamical  system,  typically  with 
the  purpose  of  regulating  certain  variables  or  tracking  desired  signals.  In  most  cases,  either  stability  of 
the  closed-loop  system  is  an  explicit  requirement  or  the  problem  can  be  recast  in  a  form  that  involves  sta¬ 
bilization  (e.g.,  of  an  error  signal).  For  linear  systems,  the  associated  problems  can  now  be  treated  fairly 
satisfactorily,  but  in  the  nonlinear  case  the  area  is  very  far  from  being  settled.  The  emphasis  of  the  Pi’s 
work  has  been  mainly  on  questions  of  (global)  stabilization,  both  in  the  state-space  and  input/output 
senses.  State-space  stability  relates  to  classical  dynamical  systems  ideas;  in  many  practical  situations,  it 
can  be  achieved  by  means  of  linearization  under  feedback  (Brockett,  Hunt,  Meyer,  Su,  Jakubczyk,  Re- 
spondek),  via  control-Lyapunov  ideas  (Artstein,  Jurdje vie- Quinn,  Tsinias),  via  the  promising  approach 
of  zero-dynamics  (Byrnes  and  Isidori),  or,  for  more  loctd  studies,  through  Center  Manifold  Techniques 
(Abed,  Aeyels,  Bacciotti,  Boothby,  Marino,  Crouch,  and  many  others).  Input/output  stability  devel¬ 
oped  in  parallel,  often  using  techniques  based  on  small-gain  arguments  (Desoer,  Sandberg,  Vidyasagar, 
Zames,  2md  others).  It  is  perhaps  surprising  that  these  two  frameworks  are  not  automatically  related,  as 
is  the  case  for  linear  systems.  (Even  for  feedback  linearizable  systems,  this  relation  is  more  subtle  than 
might  appeu:  Linearizing  a  system  and  then  stabilizing  the  equivalent  linearization  does  not  in  general 
result  in  a  closed-loop  system  that  is  input /output  stable.)  Building  on  previous  work  by  others,  the  PI 
started  in  [3]  a  line  of  research  that  leads  to  the  synthesis  of  i/o  stabilizing  laws  starting  with  state-space 
stabilizers,  hence  providing  a  method  for  transferring  results  from  one  context  to  the  other. 

Lyapunov  functions  are  often  employed  in  practical  control  design  and  in  robust  control  theory. 
A  systematic  technology  is  being  developed  for  obtaining  explicit  feedback  laws  from  given  “control- 
Lyapunov”  functions.  This  theory  elaborates  and  refines  previous  work  by  many  authors. 

Another  direction  of  research  deals  with  saturation  effects;  even  for  linear  systems,  the  necessary 
theory  requires  nontrivial  nonlinear  tools.  (According  to  the  book  by  Slotine  and  Li,  “saturation  is 
probably  the  most  commonly  encountered  nonlinearity  in  control  engineering.” )  Recent  work  coauthored 
by  the  PI  has  resulted  in  general  techniques  for  stabilizing  systems  in  the  presence  of  control  saturation. 
This  line  of  work  also  motivated  research  of  the  PI  and  students  into  other  related  issues,  such  as  the 
effect  of  saturation  and  finite  precision  on  observability. 
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One  component  of  the  project  concerns  itself  with  neural  netvork  approaches  to  control.  Many 
authors,  starting  with  Narendra  and  his  coworkers,  have  shown  experimentally  the  feasibility  of  nets  as 
models  for  nonlinear  feedback.  Work  by  the  PI  has  focused  on  the  understanding  of  neural  computation 
per  it  and  as  a  technique  for  nonlinear  control.  A  new  result  showed  that  nets  with  four  layers  (also 
called  “two  hidden  layer  nets")  eire  necessary  (as  well  as  sufficient)  for  the  solution  of  typical  nonlinear 
control  problems.  While  less  layers  are  sufficient  in  the  linear  case,  controllers  used  in  current  designs, 
based  on  three  layers,  ^lre  not  rich  enough  to  deal  with  nonlinearities. 

V£irious  other  topics  in  nonlinear  systems  are  also  discussed.  Among  these  cire  the  topic  of  represen¬ 
tation  of  i/o  behavior  by  algebraic  differential  equations,  which  is  important  when  combining  control 
with  identification.  Discrete-time  systems  and  the  associated  restrictions  imposed  by  sampling  are  also 
mentioned,  as  recent  work  of  the  PI  has  dealt  with  fundcimental  issues  raised  by  digital  control  of  non¬ 
linear  systems.  Finally,  the  report  deals  with  some  questions  on  the  control  of  Hamiltonian  systems, 
which  exhibit  structure  that  is  useful  in  modeling  mechanical  systems. 

The  topics  will  be  grouped  according  to  the  following  broad  categories: 

1.  State-Space  and  I/O  Stabilization 

2.  Systems  with  Saturation 

3.  Control-Lyapunov  Functions 

4.  Neural  Network  Approaches 

5.  Other  Topics 

•  Discrete-Time  Control 

•  Hamiltonian  Systems 

•  Input/Output  Equations  < 

•  Sign-Linear  Systems 


2  State-Space  and  I/O  Stabilization 

A  great  deal  of  effort  baa  been  directed  by  many  towfirds  the  general  problem  of  stabilizing  systems 

x  =  f{x,u)  (1) 

with  respect  to  a  given  equilibrium  point;  see  for  instance  the  survey  paper  [43],  which  includes  a  rather 
Icirge  bibliography,  as  well  as  the  respective  sections  of  the  books  cited  earlier.  In  order  to  talk  about 
stabilization,  which  deals  with  closed-loop  behavior,  it  is  first  necessary  to  understand  what  is  meant 
by  “stability”  of  an  open-loop  system  such  as  (1).  Technicalities  aside,  there  are  two  conceptually  very 
different  manners  of  defining  this  notion. 

The  first  approach  to  defining  stability  of  control  systems  relies  on  the  standcird  Lyapunov  definition 
from  dyneimiced  systems  theory,  and  disregards  the  control:  Global  asymptotic  stability  of  the  origin 
for  the  system  x  =  f{x,0)  obtained  by  setting  «  =  0  (assume  /(O,  0)  =  0).  This  notion  is  called  state- 
space  stability  or  zero-input  stability.  (One  may  also  consider  the  corresponding  local  definitions;  for 
simplicity,  the  following  discussion  is  only  for  the  global  case.) 

An  alternative  way  of  introducing  stability  for  (1)  arises  from  operator- theoretic  approaches  to  sys¬ 
tems.  In  essence,  what  is  desired  is  not  only  that  the  system  be  zero-input  stable  as  described  above, 
but  that,  in  addition,  a  “nice”  input  u(-)  should  produce  a  “nice”  state  trajectory  j:(-)  when  starting 
from  any  initied  state.  That  is  to  say,  one  imposes  a  condition  on  the  operator  “(initi£d  state, control) 
►-*  ensuing  state  trajectory.”  This  input/outpui  (or,  unless  only  partial  observations  are  of  interest, 
input-to- state)  stability  is  central  to  the  study  of  robustness  with  respect  to  actuator  and  sensor  noise, 
stability  using  partial  measurements,  and  controller  parameterization.  There  are  many  possible  precise 
definitions  of  input /output  stability.  One  possibility  is  to  add  the  requirement  BIBS:  bounded  inputs 
produce  bounded  state  (or  output)  trajectories.  Even  here,  there  are  variants:  The  state  bounds  could 
be  required  to  depend  only  on  input  and  initial  state  bounds  — but  not  on  the  actual  vedues  of  these — , 
and  this  dependence  could  be  required  to  be  linear,  which  gives  rise  to  “finite-gain”  stability  (“finite 
incremental  gain”  if  the  operator  is  not  just  continuous  but  also  Lipechitz).  These  issues  are  discussed 
in  textbooks  by  Vidyasagar  and  others.  For  the  purposes  of  the  present  discussion,  i/o  stability  will 
simply  mean  state-space  stability  plus  BIBS.  With  this  meaning,  a  basic  fact  is  as  follows.  (See  [3],  [28] 
for  proofs  of  various  versions  of  this  result.) 

Theorem.  I/O  stability  implies  that  controls  that  converge  to  zero  produce  trajectories  that  converge  to 
zero,  from  any  initial  state. 

Contrary  to  the  situation  that  holds  for  linear  systems,  in  general  state-space  stability  does  not 
imply  i/o  stability.  This  is  illustrated  by  the  trivial  example  x  =  —x  the  system  is  zero-input 

stable  but  u  =  1  makes  every  trajectory  with  x(0)  >  1  escape  to  infinity  in  finite  time.  The  gap 
between  the  concepts,  eind  associated  problems,  have  been  known  for  a  long  time,  and  appear  in  slightly 
different  form  in  the  classical  study  of  “total  stability.”  In  a  control  context,  there  has  been  work 
characterizing  restrictive  conditions  under  which  the  implication  does  hold.  One  such  case  is  that  of 
systems  with  globally  Lipechitz  right-hand  side  and  exponentially  stable  dyn£unics  for  u  =  0,  as  done  in 
work  by  Varaiya  tind  Liu  in  the  mid-lQfiOs  and  by  Sastry  and  Isidori  (but  note  that  this  result  is  false  if 
asymptotic  stability  is  not  exponential,  as  illustrated  by  the  example  x  =  —  tanhx  -f-  u). 

Given  that  the  two  broad  notions  of  stability  do  not  in  general  coincide,  it  makes  sense  to  ask  the 
design  question:  If  one  can  make  a  system  state-space  stable  by  using  feedback,  can  one  ailso  make  it  i/o 
stable? 

The  stabilization  problem  is  that  of  finding  a  feedback  law  of  the  type  u  =  ib(x)  -I-  0(x)v,  ifc(O)  =  0, 
so  that  the  closed-loop  system  x  =  F{x,v)  =  /(r,  fc(x) -f /?(x)v)  is  stable  in  the  desired  sense  (with 
new  control  «).  That  is,  one  wautb  a  system  which  is  feedback  equiualent  to  the  original  one  and  stable; 
as  usual  in  nonlinear  control,  one  requires  that  the  square  matrix  0(x)  be  invertible  for  all  x,  so  no 
instantaneous  controllability  is  lost.  Note  that  the  more  restricted  problem  of  state-space  stabilization  is 
that  of  finding  just  k  {as  0is  now  irrelevant)  so  that  x  =  F(x,  0)  ;=  /  (x,  ife(x))  be  globally  asymptotically 
stable;  for  i/o  stabilization  one  wants  that  in  addition  x  =  F(x,v)  be  BIBS.  It  is  perha[>s  surprising, 
given  the  gap  between  the  two  properties,  that  if  a  system  is  stabilizable  in  the  state-space  sense  then 
it  is  also  stabilizable  in  the  i/o  sense.  More  precisely; 
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Theorem.  If  then  is  a  smooth  k  so  that  x  =  F{x,  0)  is  state-space  stable  then  there  are  also  a  {generally 
different)  smooth  k  and  a  smooth  /3  so  that  x  =  F(z,v)  is  i/o  stable. 

This  waa  proved  in  [9].  The  paper  [3]  had  previously  shown  that,  for  systems  affine  in  controls 

X  =  f{x,u)  =  /o(i)  +  Gix)u  (2) 

one  may  always  take  0  =  identity.  Models  of  this  type,  possibly  with  control  bounds,  cover  most 
interesting  £lerosp^tce  finite-dimensional  control  applications.  (The  blanket  assumption  is  being  made, 
when  stating  the  above  and  latter  results,  that  all  systems  considered  have  smooth,  i.e.  infinitely  differ¬ 
entiable,  right-hand  side  /,  and  that  states  x{t)  and  control  values  u(t)  lie  in  Euclidean  spaces  IR"  and 
IR"*  respectively,  though  far  less  is  needed  in  general.) 


2.1  Cascades 

The  concept  of  i/o  stability  is  particularly  useful  when  studying  cascades  of  systems,  because  series 
connections  of  i/o  stable  systems  are  again  i/o  stable.  (In  contrast,  series  connections  of  state-space 
stable  systems  are  not  necessarily  -globally-  state-space  stable.)  By  a  casccide  one  means  a  system  with 
triangular  structure 


*  = 

z  =  g(z,u). 

One  can  easily  stabilize  a  cascade  if  it  is  known  that  the  first  system  (the  z-subsystem)  is  stabilizable  and 
that  the  second  one  (x  =  /(x,  z))  is  i/o  stable.  As  discussed  in  (24)  emd  [28],  sometimes  it  may  be  possible 
to  use  a  preliminary  feedback  that  makes  the  second  system  i/o  stable,  as  needed  for  the  argument  to 
hold.  The  idea  can  be  applied  to  systems  that  admit  various  types  of  partial  linearization,  such  as  the 
standard  model  for  the  angular  momentum  of  a  satellite  controlled  by  two  pairs  of  opposing  gaa  jets.  In 
terms  of  the  angles  between  a  body  frame  and  a  fixed  frame,  under  some  simplifying  assumptions  the 
equations  become 

wi  =  A1W2W3 -1- aiui 
uij  =  Ajwj  »)3 -f  ajtij 

W3  =  A3W1W2  • 

The  Aj’s  are  related  to  the  inertial  coefficients,  and  j43,  01,02  are  all  nonzero.  Then  the  procedure 
results  in  the  simple  feedback  law 

Ui  =  — Wi  —  W2  —  W2<*^3  ,  U2  =  Wi  —  W3  -f-  2W1W2W3  . 

which  globally  stabilizes  the  equilibrium  w  =  0.  Indeed,  under  feedback  and  coordinate  changes,  one 
may  simplify  the  equations  to 

X  =  yz 
y  =  «i 
z  =  U2 

which  has  the  form  of  a  scalar  system  x  =  viV2  cascaded  with  two  integrators.  If  the  system  x  =  t»iT>2  is 
first  made  to  be  i/o  stable  (which  one  knows  can  be  done,  because  it  is  clearly  state-space  stabilizable, 
and  using  the  results  cited  earlier)  then  it  may  be  expected  that  the  cascade  can  also  be  stabilized. 
Indeed,  letting  t>i  =  — x  -1-  U)i,n2  =  x^  u>2  the  equation  x  =  t;it>2  becomes  i  =  — x^  -H  ^(x,  uu.w’z) 
which  is  i/o  stable  since  q  has  degree  less  than  3  in  x.  In  terms  of  the  new  variables  t]  :=  x  +  y  and 
(^  =  z  -  x^,  the  closed-loop  system  consists  of  the  system  >7  =  -q,  C  =  -C  feeding  into 

X  =  -x^ -i-q(x,ri,Q 
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and  is  therefore  globally  asymptotically  stable.  A  different  control  law  can  be  obtained  for  this  satellite 
model  using  instead  zero-dynamics  design  (work  by  Byrnes  and  Isidori).  Performance  comparisons 
between  different  techniques  are  as  yet  unclear. 


2.2  Coprime  Factorizations 

There  has  been  considerable  interest  in  psirameterizations  of  controllers  for  nonlinear  systems  (for  the 
linear  case,  see  for  instance  the  textbook  [1],  Section  6.5).  This  has  motivated  the  8e^Lrch  for  coprime 
factorization  conditions,  with  important  contributions  by  Desoet,  Hammer,  Hunt,  Krener,  Verma,  and 
others.  The  paper  [26]  constructed  factorizations,  giving  formulas  that  reduce  automatically  in  the  linear 
case  to  the  by-now  “classical”  formulas  that  the  PI  had  obtadned  with  Khargonekar  in  the  IQSOs. 

More  precisely,  consider  the  system  (1)  and  a  fixed  initial  state  xq,  and  let  P  :  V{P)  — *  ,, 

where  'D{P)  C  I™  g,  be  the  operator  obtained  by  defining  P(u)  :=  state  resulting  from  input  u(  )  and 
initial  state  xq.  Here  ^{P),  the  domain  of  P,  is  the  set  of  controls  for  which  this  solution  is  well- 
defined  for  eill  t,  and  ^  denotes  the  set  of  measurable  essentially  bounded  maps  [0,  oo)  — *  H*.  for 
any  k.  The  operator  P  admits  a  coprime  right  factorization  if  there  exist  three  i/o  stable  operators 
A  :  ,  X  g  — ►  iJo.e'  ^  ^  tli^t  D  is  causally  invertible, 

V{D~^)  =  'D{P),  P  =  ND~^  cind,  if  /  denotes  the  identity  in 


The  precise  definition  of  i/o  stable  operator  is  given  in  [3],  but  for  purposes  of  the  present  discussion,  it 
can  be  taken  to  mean  that  inputs  converging  to  zero  produce  outputs  that  also  converge  to  zero.  In  [26] 
it  is  shown  that:  If  (1)  is  smoothly  stabilizable  then  its  input  to  state  mapping  admits  a  coprime  right 
factorization.  A  version  of  this  result  in  terms  of  “Bezout”  factorizations,  for  which  A  can  be  split  into 
two  parts  and  the  familiar  formulas  VD  +  SN  =  /  appear  instead,  was  given  in  [3],  for  systems  affine  in 
controls. 

If  there  is  also  given  an  output  map  y  =  h(x)  and  P  is  now  the  operator  u  i— »  y,  then  [26]  shows 
how  to  extend  the  result  on  existence  of  factorizations  under  the  additioned  assumption  that  an  observer 
exists. 


3  Systems  With  Saturating  Controls 

Nonlinefir  control  provides  tools  that  allow  one  to  deal  with  certain  questions  that  Me  on  the  surface 
of  an  apparently  linesir  nature.  Particularly  interesting  examples  of  such  questions  deal  with  actuator 
saturation  in  linear  systems.  (Saturation  of  actuators  is  a  real  and  potentially  important  effect,  as 
evidenced  by  the  classical  case  of  an  X-15  experimental  aircraft  that  crashed  in  1966  due  to  ciilerons 
reaching  nraximum  deflection,  causing  loss  of  controllability  2dong  the  roll  axis.)  The  search  for  controllers 
of  systems  subject  to  such  saturation  can  be  seen  as  a  problem  in  nonlinear  control,  and  that  is  the  point 
of  view  taken  here.  As  a  simple  illustration,  take  the  model  of  an  airplane  flying  on  a  vertical  plane  and 
at  a  constant  ground  speed.  The  control  is  the  rate  of  the  elevator  angle,  assumed  subject  to  magnitude 
constraints.  Let  z  denote  this  angle;  the  pitch  angle  is  denoted  by  4>,  the  ground  speed  by  c,  the  flight 
path  angle  by  a,  and  the  altitude  by  h.  For  small  angles,  the  above  quantities  are  related  by  the  following 
differential  equations; 


d  =  a(4>  —  a) 

^  —  Q  —  6z) 

h  —  ca 
z  =  <t(u) 
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where  w  >  0  is  a  constant  representing  a  natural  oscillation  frequency  and  a,  b  are  positive  constants. 
The  saturation  nonlineruity  a  is  shown  explicitely,  for  emphasis;  it  could  be,  for  instance,  the  function 
<t(u)  =  u  for  |u|  <  1,  (7(u)  =  signu  otherwise.  A  routine  application  of  linear  control  theory  provides 
a  stabilizing  law  if  one  disregards  the  bounds.  But  with  saturation,  glob£il  stability  is  of  course  not 
guaranteed  (it  is  easy  to  compute  examples  showing  this  failure  of  stability).  This  remark,  that  linear 
laws  when  saturated  can  lead  to  instability,  has  motivated  much  past  research;  in  tracking  problems  and 
some  disturbance  rejection  problems,  for  example,  the  phenomenon  called  “integrator  wind-up”  often 
arises  when  using  a  linear  integral  feedback  law  derived  by  ignoring  saturation  limits. 

Many  authors  have  proved  estimates,  -using  the  circle  criterion  and  other  techniques  related  to 
small-gain  analysis,-  to  guarantee  stability  in  regions  of  the  state-space.  But  rather  than  asking  when 
a  linear  control  law  u  =  Fx  remains  globally  stabilizing  when  saturated,  or  estimating  the  domain 
where  attr£u;tivity  still  holds  if  not  globally  stabilizing,  in  joint  work  with  Sussmann  we  considered  in 
[33]  the  system  as  a  nonlinear  system,  taking  the  saturation  into  account  in  the  model.  This  was  of 
course  not  a  new  idea,  in  so  far  as  optimal  control  techniques  can  be  applied  -resulting  for  instance  in 
a  bsing-bang  control  law  for  the  above  airplane,  when  solving  a  time-optimal  problem.  But  by  looking 
for  non- necessarily  optimal  laws,  one  finds  more  smooth  controllers.  The  paper  [33]  gave  a  very  general 
result  on  stabilization  ot  linear  systems  with  input  saturation,  resulting  in  smooth  feedback  laws.  The 
hypotheses  made  in  [33]  apply  in  pcirticular  to  the  above  airplane  example.  Work  in  progress  h2k8  resulted 
in  a  simple  and  very  explicit  representation  of  the  needed  feedback  laws.  This  work  uses  in  cin  essential 
manner  the  theory  of  i/o  stability  discussed  earlier. 

The  class  of  systems  considered  in  [33]  is  given  as  in: 

X  —  Ax  +  B  9(u)  ,  (3) 

where  6(u)  =  (<t(ui),  . .  .,<T(um))'  and  a{u)  is  a  saturation  function  as  above.  Here  A  and  B  are  n  x  n 
and  n  X  m  matrices  respectively,  and  cr  :  IR  —*  IR  is  assumed  bounded,  globally  Lipschitz,  continuously 
differentiable  at  the  origin,  and  with  <7'(0)  ^  0.  (This  includes  for  instance,  the  “squashing"  function 
given  by  the  standard  sigmoid  tanh(u),  as  well  as  the  saturation  function  discussed  earlier.)  Of  interest 
are  only  global  problems;  local  stabilization  can  always  be  achieved  by  the  use  of  a  line2ur  control  law. 
One  of  the  main  results  in  [33]  is  as  follows: 

Theorem.  For  the  system  (3),  there  is  a  globally  (state-space)  stabilizing  smooth  feedback  if  and  only  if 
the  system  is  asymptotically  null- controllable,  that  is,  if  from  any  state  one  can  asymptotically  reach  the 
origin. 

In  other  words,  subject  only  to  the  obvious  necessary  condition,  there  are  smooth  feedback  stabilizers. 
As  a  corollary,  one  can  also  obtain  a  feedback  guaranteeing  i/o  stability.  Furthermore,  asymptotic  null- 
controllability  for  these  systems  is  easy  to  cheiracterize  by  a  well-known  criterion:  The  pmr  (A,  B)  must 
be  stabilizable  in  the  ordinary  sense,  smd  ail  eigenvalues  of  A  must  have  nonpositive  real  peirt. 


4  Control-Lyapunov  Functions 

Consider  a  system  affine  in  controls,  as  in  (2).  If  there  is  some  feedback  law  k  that  stabilizes  in  the  state- 
space  sense,  and  if  i  is  continuous  away  from  the  origin,  then  converse  Lyapunov  theorems  guajMtee 
the  existence  of  a  positive  definite  (i.e.,  K(0)  =  0  and  V{x)  >  0  for  x  /  0,)  and  proper  (i.e.,  V(x)  — •  oo 
as  (|x||  — ♦  oo)  smooth  function  V  :  IR"  — » IR  such  th<»l  energy  can  be  decreased  with  open-loop  controls. 
That  is,  V  is  a  control  Lyapunov  function  (clf):  it  satisfies  inf,  {a(x)  -j-  B(x)  u]  <  0  for  each  x  ^  0.  with 
the  notations  a(x)  :=  VV(x)  fo(x)  and  B(x)  =  (6i(x), . . . ,  6m(a:))  •=  W(x)G(x).  Moreover,  if  k  is 
continuous  at  the  origin,  then  this  function  has  the  additional  small  control  property  (sep)  [with  respect 
to  (2)]:  controls  can  be  picked  small  if  the  state  is  small.  (That  is:  For  each  <$  >  0  there  is  an  f  >  0  such 
that,  if  X  ^  0  satisfies  ||x||  <  e,  then  there  is  some  u  with  ||uj|  <  6  such  that  a(x)  +  B(x)u  <  0.) 

In  a  1971  paper  the  PI  had  showed  that  that  the  existence  of  a  clf  is  in  fact  also  necessary  if  there  is 
just  asymptotic  controllability,  that  is,  if  from  euiy  state  one  can  asymptotically  reach  the  origin,  provided 
that  one  does  not  require  smoothness  of  V  and  the  defining  equation  is  replaced  by  an  equation  involving 
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Dini  derivatives.  Independently,  Artstein  showed  at  about  the  same  time  that  if  there  is  a  smooth  clf 
V,  then  there  is  a  feedback  law  which  globally  stabilizes  the  system,  and  k  is  smooth  on  E.”  —  {0}.  If  in 
addition  V  satisfies  the  scp,  then  fc  can  be  chosen  to  be  almost  smooth  on  E",  meaning  not  only  smooth 
away  from  the  origin,  but  also  continuous  on  all  of  E". 

One  goal  in  smooth  feedb£u:k  stabilization  is  to  provide  conditions  under  which  asymptotic  controlla¬ 
bility  implies  smooth  feedb^lck  stabilizability;  the  results  just  mentioned  say  that  the  former  corresponds 
to  existence  of  continuous  elf's,  and  the  latter  to  the  existence  of  smooth  such  functions. 

Since  clf’s  are  as  a  generjil  rule  easier  to  obtain  than  the  feedback  laws  themselves  -after  all,  in  order 
to  prove  that  a  given  feedback  law  stabilizes,  one  often  has  in  addition  to  provide  a  suitable  Lyapunov 
function,-  Artstein’s  Theorem  provides  in  principle  a  very  powerful  approach  to  nonlinear  stabilization. 
However,  until  recently  all  proofs  relied  on  nonconstructive  (partition  of  unity)  arguments.  To  make  it 
a  practical  technique,  one  needs  a  more  explicit  construction.  In  [10]  the  PI  gave  one  such  explicit,  very 
elementary,  construction  of  k  from  V  and  the  vector  helds  deRning  the  system.  A  further  advantage  of 
the  method  in  [10],  in  addition  to  its  extreme  simplicity  and  ease  of  implementation,  is  that  it  provides 
automatically  an  analytic  feedback  law  if  the  original  vector  fields  m  well  cts  the  clf  mc  analytic. 

The  construction  in  [10]  is  based  on  the  following  argument,  which  for  simplicity  is  given  here  only  for 
single-input  (m  =  1)  systems.  Assume  that  V  is  a  clf  for  the  system  x  =  f(x)  -I-  ug{x).  Denote  a(x)  := 
VV(x)./(z),  b(x)  :=  W(x).g{x).  The  condition  that  V  is  a  clf  is  precisely  the  statement  that  b{x)  ^ 
0  ^  a(i)  <  0  for  all  nonzero  x.  In  other  words,  for  each  such  x,  the  pair  (a(x),  b(  x))  is  stabilizable  when 
seen  as  a  single-input,  one-dimensional  linear  system.  On  the  other  hand,  giving  a  feedback  law  u  =  k(x) 
for  the  original  system,  with  the  property  that  the  same  V  is  a  Lyapunov  function  for  the  obtmned 
closed-loop  system  i  =  f(x)  +  k(x)g(x)  is  equivalent  to  asking  that  VV(x).  (/(i)  +  ib(i)g(x))  <  0,  that 
is,  a{x)  +  k{x)b{x)  <  0  for  all  nonzero  x.  In  other  words,  k{x),  seen  as  a  1  x  1  matrix,  must  be  a  constant 
linear  feedback  stabilizer  for  (a(x),6(x)),  for  each  fixed  z. 

Now  interpret  (a(x),  6(x))  as  a  family  of  linear  systems  parameterized  by  x.  This  family  depends 
smoothly  on  x.  From  the  theory  of  families  of  systems  or  “systems  over  rings”  one  knows  that  since  each 
such  linear  system  is  stabilizable  there  exists  indeed  a  smoothly  dependent  fc  as  wanted.  Moreover,  this 
fc  can  be  chosen  to  be  analytically  or  rationally  dependent  if  the  original  family  is,  that  is,  if  the  original 
system  and  clf  axe.  The  result  in  the  smooth  and  einalytic  cases  is  due  to  Delchamps  (see  for  instance 
[1],  Exercise  7.5.11),  but  in  this  very  simple  case  (the  family  is  one-dimensional),  the  construction  of  fc 
c«m  be  carried  out  directly  without  explicit  recourse  to  the  general  result.  Indeed,  one  can  show  directly 
that  the  following  feedback  law:  fc  ;=  (with  fc(x)  :=  0  when  6(x)  =  0)  works.  This  results 

from  the  solution  of  an  LQ  problem,  and  is  analytic,  in  fact  algebraic,  on  a.  b.  (The  apparent  singul£irity 
due  to  division  by  b  is  removable.)  Along  trajectories  of  the  corresponding  closed-loop  system,  one  has 
that  ^  <  0  as  desired.  This  feedback  law  may  fail  to  be  continuous  at  zero.  However,  if 

one  modifies  it  slightly  to  fc  :=  —  jt  does  become  continuous  (under  the  scp  assumption). 

In  connection  with  the  discussion  on  i/o  stability,  it  is  worth  remarking  that,  provided  that  the 
function  a(x)*  -I-  b(x)^  is  proper  (“radially  unbounded”  is  the  terminology  in  the  engineering  literature) 
the  above  law  gives  automatically  also  i/o  stability,  when  using  (3  =  1. 

The  clf  work  has  recently  been  extended  to  bounded  controls  in  [16],  and  nonnegative  controls  in  [37]. 


To  illustrate  the  latter  results,  take  the  case  of  single-input  systenns  (m  =  1)  and  control  value  set  the 
unit  interval  (—1, 1)  (or  the  corresponding  closed  interval).  Now  the  assumption  is  that  in  the  equation 
defining  the  clf  property,  controls  are  restricted  to  the  allowed  control-value  set.  If  V  is  a  clf  satisfying 


the  scp,  then 


fc(a,6) 


1  + 


if  5  0, 


(4) 


if  6  =  0. 


globally  stabilizes,  is  real-analytic  in  o,  b,  and  has  values  always  with  magnitude  less  than  1.  In  addition, 
this  is  guaranteed  to  be  continuous  at  the  origin  (hence  alinost-smooth  in  the  sense  mentioned  above). 
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5  Neural  Network  Approaches 


There  has  been  much  activity  lately  in  the  aie&  encompassed  by  the  term  “neural  networks,”  and  many 
practical  successes  of  the  associated  technologies  have  been  reported  both  in  the  scientific  and  in  th*“ 
popular  press.  A  recent  workshop  (October  24-26,  1990)  at  the  McDonnell  Douglas  Corp.,  attended  by 
researchers  from  various  Air  Force  contractors  ^lnd  development  labs,  centered  on  aerospace  applications 
of  neural  nets.  Several  presentations  focused  on  the  use  of  network  techniques  in  flight  systems  design, 
such  aa  fault  detection  and  classification  (and  aissociated  problems  of  reconfigurable  aircraft  control), 
development  of  controls  valid  over  iMge  flight  envelopes,  and  even  precision  laying  of  composites  on 
ciircraft  structures.  A  recurrent  topic  of  discussion  during  the  workshop  vrae  the  lack  of  theoretical 
foundations  for  the  cinalysis  and  comparison  of  different  network  tools. 

The  PI  is  engaged  in  a  program  of  research  whose  mmn  purpose  is  to  crirry  out  a  rigorous  mathe¬ 
matical  anedysis  for  problems  in  neural  nets.  Such  a  development,  besides  being  intrinsically  of  interest, 
will  lead  to  a  better  understanding  of  the  issues  involved  in  the  design  of  efficient  algorithms  aa  well  as 
in  understanding  the  capabilities  and  limitations  of  these  models.  Some  of  this  work  dealt  with  the 
fact  that,  among  two  possible  variants  of  the  so-called  backpropagation  training  method  for  sigmoidal 
nets,  both  of  which  are  used  in  practice,  one  is  a  better  generalization  of  the  older  perceptron  training 
cilgorithm  than  the  other  (see  e.g.  [13]).  Various  results  on  the  local  minima  structure  of  the  associated 
grauiient  descent  problems  were  obtained  too  (see  [8]).  New  representation  results  showed  that  nets  con¬ 
sisting  of  sigmoidal  neurons  have  at  least  twice  the  representational  capabilities  of  nets  that  use  classical 
threshold  neurons,  at  least  when  this  increase  is  quantified  in  terms  of  classification  and  interpolation 
power  (see  [32],  [47]  [48],  [18]).  Other  recent  work  established  a  basic  result  quantifying  the  capabilities 
of  neural  nets  as  universal  computing  devices  (see  [19]). 

One  of  the  main  lines  of  work  in  this  research  has  dealt  with  nets  as  controllers.  We  showed  that  “two 
hidden  layer  nets”  aie  necessciry  as  well  cis  sufficient  for  the  solution  of  typical  nonlinear  control  problems. 
Most  current  experimental  work  uses  sin^le-hidden-layer  nets,  based  on  ?,p  (incorrect)  intuition  grounded 
on  well-known  approximation  theorems. 

Nets  with  Heaviside  nonlinearities  can  be  seen  as  implementing  a  particular  type  of  discontinuous 
feedback  strategy.  The  basic  obstruction  has  to  do  with  the  power  of  hidden  units  in  allowing  the 
existence  of  sections  of  certain  projections.  Topological  contraints  on  what  can  be  done  with  just  one 
hidden  layer  imply  that,  even  though  one  such  layer  is  indeed  sufficient  when  controlling  linear  sytems, 
the  structure  is  not  rich  enough  to  deal  with  nonlinear  control  problems,  as  illustrated  iu  [40]. 

Figure  1  illustrates  a  net  with  two  hidden  layers  and  a  single  output  neuron.  The  processing  elements 
( “neurons” )  receive  inputs  from  preceding  layers,  and  evsduate  a  fixed  nonlinear  function  0  of  a  weighted 
sum  of  these  inputs.  In  neural  net  practice,  one  often  takes  ^  to  be  the  standard  sigmoid  0{x)  = 
‘^(*)  =  or  equivalently,  up  to  translations  and  change  of  coordinates,  the  hyperbolic  tangent 

0(x)  =  tanh(z).  Another  usual  choice  is  the  hardlimiter,  Heaviside,  or  tAresAoW function  0(x)  =  7f(z)  =  0 
if  r  £  0  and  =  1  if  z  >  0,  which  can  be  approximated  well  by  a(yx)  when  the  “gain”  y  is  large.  Most 
of  the  analysis,  including  studies  of  circuit  complexity  and  the  theory  of  threshold  logic,  has  been  done 
for  ?t,  but  in  practice  one  often  uses  the  standard  sigmo’d.  Direct  connections  from  input  neurons  to 
the  output  neuron  are  sometimes  allowed;  they  add  a  lineau  term  to  the  function  computed  by  such  a 
net.  In  some  studies  the  output  is  passed  through  a  last  nonlinearity,  but  for  many  purposes,  such  as 
function  interpolation,  this  is  undesirable.  Also,  more  than  one  output  neuron  may  be  of  interest,  and 
this  can  be  easily  incorporated  in  the  model. 

Consider  nonlinear  control  systems 


z(t -t-l)  =  P(z(t),  u(t))  (5) 

whose  states  evolve  in  IR",  having  controls  u(t)  that  take  values  in  E.*",  and  with  P  suflSciently  smooth 
and  satisfying  P(0, 0)  =  0.  We  assume  that  the  system  can  be  locally  stabilized  with  linear  feedback, 
i.e.  there  is  some  matrix  F  so  that  the  closed  loop  system  with  right-hand  side  P(x(t).  Fx{t))  is  locally 
asymptotically  stable.  The  system  (5)  is  asymptotically  controllable  if  for  erich  state  zq  there  is  some 
infinite  control  sequence  u(0),  u(l),  •  •  •  such  that  the  corresponding  solution  with  z(0)  =  zo  satisfies  that 
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Figure  1:  Feedforward  Net. 


x(t)  —*  0  &8  t  -*  oo.  ThU  condition  is  obviously  the  weakest  possible  one  if  any  type  of  controller  is 
to  stabilize  the  system.  We  say  that  K  :  R"  — ♦  IR™  is  a  type-1  feedback  if  each  coordinate  /  of  is  a 
single-hidden  layer  net  with  possible  conections,  and  that  it  is  a  type-2  feedback  if  it  can  be  written  in 
this  msmner  with  each  /  being  a  two-hidden  layer  net.  These  are  feedback  laws  that  can  be  computed 
by  nets  with  one  or  two  hidden  layers  respectively,  and  having  m  output  neurons  emd  possible  direct 
connections  from  inputs  to  outputs  (these  connections  provide  the  linear  term).  Then  one  will  have: 

Theorem.  Let  9  =  7i.  For  each  system  as  above,  and  each  compact  subset  C  of  the  state  space,  there 
exists  some  feedback  law  of  type  2  that  globally  stabilizes  (5)  on  C,  that  is,  so  that  C  is  in  the  domain 
of  asymptotically  stability  of  =  P(z,  ifr(z)).  On  the  other  hand,  there  exist  systems  aa  above,  ^lnd 
compact  sets  C,  for  which  no  possible  feedback  law  of  type  1  stabilizes  C.  I 

The  negative  result  remains  if  9  =  tanh,  or  if  9  is  one  of  many  other  functions  used  in  neural  net 
practice. 

One  explicit  illustration  of  the  obstructions  due  to  just  one  hidden  layer,  for  a  tracking  problem,  is 
as  follows.  Assume  that  it  is  desired  to  control  a  planar  four-link  rotational  manipulator,  with  torques 
being  applied  at  each  joint.  It  is  assumed  that  unmeasured  disturbances  affect  the  first  two  joints,  and 
what  is  desired  is  a  control  law  which,  given  a  reference  tip  position  and  the  current  angles  of  the  first 
two  joints,  will  produce  a  set  of  coordinates  for  the  last  two  joints  resulting  in  the  weinted  tip  location. 
(See  Figure  5.)  In  particular,  choosing  joint  constrmnts  9^  £  ^t/2,  t/2],i  =  1,2,  O3  G  [-7t/4,  t/4], 
9^  €  [t/4,  3ir/4],  and  link  lengths  li  =  I2  =  Lfa  =  6, 1^  =  GV2,  it  can  be  proved  that  the  problem  is 
solvable  using  two  hidden  layers  but  not  using  just  one  hidden  layer. 

6  Other  Topics 

Various  other  topics  were  treated  in  this  project,  related  to  nonlinear  control  but  different  from  stabi¬ 
lization.  Some  of  the  work  dealt  with  discrete-time  control  systems,  in  particular  with  the  generalization 
of  the  Chow-Krener  Lemma  from  continuous  time,  amd  the  application  of  such  concepts  to  the  analysis 
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of  chaotic  systems.  Other  work  dealt  with  the  representability  of  systems  by  high  order  differentied 
equations,  and  prefiltered  versions  of  these,  as  needed  for  jwirameter  identification.  Another  line  of  work 
imposed  mechanical  (energy)  constraints  in  the  form  of  the  equations  (2),  and  provided  results  that 
then  apply  to  time-optimal  problems  for  manipulators.  Finally,  a  fair  amount  of  effort  has  been  directed 
towards  the  study  of  the  effect  of  saturations  and  quantization  on  other  systenrs  properties  such  as 
observability  and  reedizability. 


6.1  Nonlinear  Discrete-Time  Systems 

Modern  control  techniques  typically  result  in  complex  regulation  mechanisms,  which  must  be  imple¬ 
mented  using  digitaJ  computers.  Consequently,  an  important  area  of  research  is  that  of  studying  the 
constraints  imposed  by  computer  control. 

The  behavior  of  continuous-time  plants  under  digital  control  can  be  modeled  by  discrete-time  systems. 
Starting  in  the  mid-seventies  in  joint  work  with  Rouchaleau,  the  PI  had  been  interested  in  problems  of 
control  for  nonlinear  discrete  time  systems.  During  the  early  1980s  the  focus  shifted  largely  to  questions 
of  accessibility  and  controllability.  This  work  benefitted  from  collaboration  with  B.  Jakubczyk,  aind 
resulted  in  the  major  paper  [2]. 

Consider  discrete-time  control  systems 

i(f+l)  =  /(x(f),ti(0),  «  =  0,1,2 .  (6) 

where  for  simplicity  it  is  assumed  here  that  /  is  real-analytic  and  states  and  controls  take  values  x{t)  E  X, 
u(t)  G  IR"*,  X  C  IR"  open.  (More  generally,  one  can  deal  with  just  smooth  /,  and  states  and  controls 
taking  values  in  manifolds.)  Systems  of  this  type  but  with  discrete- valued  states  and  controls  have 
long  been  studied  in  automata  emd  sequential  machine  theory,  but  the  continuous-valued  ceise  has  only 
recently  become  the  subject  of  serious  investigation  in  so  far  as  controllability  properties  are  concerned. 

Much  interest  in  (6)  has  been  motivated  by  the  problem  of  modeling  physic£d  systems  under  digital 
control  via  sampling.  Recall  that  sampling  is  the  process  under  which  the  state  of  a  continuous  time 
system  is  measured  at  discrete  instants,  and  control  actions  are  taken  edso  at  discrete  instants  (see  e.g. 
Section  2.10  in  [1]).  The  main  point  is  that,  as  far  as  the  control  algorithm  is  concerned,  the  physical 
system  is  a  discrete-time  system  described  by  an  equation  of  the  type  (6),  where  f{x,  u)  is  the  solution 
of  the  differential  equation  (1)  at  the  end  of  an  interval  of  length  6  assuming  that  the  initial  state  was 
X  and  the  control  was  held  constantly  equal  to  u. 

The  study  of  controllability  questions  for  continuous-time  systems  has  been  the  subject  of  a  concen¬ 
trated  research  effort,  as  documented  for  instance  in  the  books  cited  earlier.  Recall  that  the  reachable 
set  or  forward-accessible  set  from  a  state  x°  €  Jf  consists  of  those  states  to  which  one  may  steer  i® 
using  arbitrary  — measurable  essentially  bounded  in  the  continuous- time  case —  controls.  The  orbit  or 
forward-backward  accessible  set  from  x°  is  defined  as  the  set  consisting  of  all  states  to  which  x°  can  be 
steered  using  both  motions  of  the  system  as  well  as  negative  time  motions.  That  is,  z  is  in  the  orbit  of 
X  if  there  exists  a  sequence  of  states  xq  =  x,  xj, . . . ,  xt  =  z  such  that  for  each  i  =  1, . . . ,  ib  either  x^  is 
reachable  from  Xj_i  or  x,_i  is  reachable  from  x,.  Negative  time  motions  eire  in  general  not  physically 
resJizable,  but  the  orbit  is  an  extremely  useful  object  to  study.  In  particular,  it  is  always  a  submanifold 
of  X  whose  dimension  can  he  obtained  from  Lie-algebraic  computations,  and  group-theoretic  techniques 
are  relevant.  In  contrast,  the  reachable  set  is  not  in  general  a  manifold,  though  one  may  define  a  ‘'di¬ 
mension”  for  it  in  various  natural  and  equivalent  ways,  for  instance  meaning  the  largest  dimension  of  a 
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submanifold  that  it  includes.  (See  [44]  for  an  exposition  of  general  theorems  on  manifold  structures  for 
orbits.) 

In  continuous-time,  a  fundamental  fcict  in  controllability  studies  is  what  may  be  called  the  Chow- 
Krener  property:  The  dimension  of  the  orbit  from  each  G  X  equals  the  dimension  of  the  reachable  set 
from  x°.  (The  property  holds  as  stated  for  analytic  systems;  in  the  more  general  smooth  case  one  would 
need  an  awldditional  Lie-algebraic  assumption.)  That  is,  the  reachable  set  contains  a  submanifold  of  the 
state  space  and  it  is  in  turn  contained  in  a  submanifold  of  the  S2Lme  dimension,  and  this  dimension  can 
be  computed  from  the  rtink  of  certain  matrices  formed  by  taking  iterated  Jacobians  of  the  vector  fields 
defining  the  system,  eveiluated  at  the  state  x°.  These  Lie-theoretic  characterizations  are  “direcf^  in  that 
they  do  not  involve  integration  of  the  differential  equation,  and  they  Jire  closely  related  to  more  classical 
geometric  material  related  to  Frobenious’  theorem. 

Perhapw  the  most  important  difference  between  discrete  and  continuous  time  is  that  the  Chow-Krener 
property  fails  for  the  former,  even  for  systems  obtained  through  the  sampling  of  one-dimensional  analy^ir 
systems;  a  counterexample  was  given  in  older  papers  by  the  PI. 

One  of  the  main  difficulties  in  the  general  discrete-time  case  is  due  to  the  possible  noninvertibility 
of  the  one-step  treinsition  maps  /„  ;=  /(•,«)  which  means  that  semigroups  tend  to  appear  where 
groupM  would  appear  in  the  continuous  case,  so  less  algebraic  structure  is  available.  An  useful  fact 
however  is  that  discrete-time  systems  that  cirise  through  sampling  are  so  that  each  of  these  maps  is 
indeed  a  diffeomorphism  (possibly  not  everywhere  defined)  of  the  state  space.  This  is  analogous  to 
the  situation  in  classical  dynamical  system  theory,  where  one  studies  time-one  diffeomorphisms  and 
Poincare  maps  ^lssociated  to  differential  equations.  The  reference  [2]  deals  with  systems  (6)  that  are 
invertible,  that  is,  the  maps  /„  are  assumed  to  be  diffeomorphisms.  For  such  systems,  the  paper  derived 
several  characterizations  of  accessibility  and  studied  the  geometric  structure  of  accessible  sets,  and  as  a 
consequence  a  theorem  was  proved  showing  that  the  Chow-Krener  property  does  hold  provided  that  the 
state  1°  be  an  equilibrium  state  (/(x°,0)  =  x°). 

The  nature  of  the  results  in  [2]  can  be  illustrated  with  an  example.  Denote  by  /*  the  k-th  power  of 
/o  with  respect  to  composition,  and  define  the  following  vector  fields  depending  on  u: 

=  -T  /«'°/-+r(x), 
r=0 

and  more  generally  for  each  integer  k  and  for  o  =  ±, 

(Ad^oX:)(x)  =  I-  /o*  O  /--  O  o  /*(x), 

where  —<t  =  — ,  if  cr  =  -f-,  —  respectively. 

Theorem.  The  following  statements  hold  for  any  analytic  system  (6)  and  equilibrium  state  x°: 

(a)  The  orbit  from  has  dimension  equal  to  the  dimension  of  the  vector  space 

Lie  {Ad^A-^  I  Jk  >  0,  u  6  lR)(x°)  . 

(b)  The  reachable  set  from  x°  has  dimension  equal  to  the  dimension  of  the  vector  space 

Lie  {AdSA-'l  Jk  €  *,  u  €  IR,  o-  =  ±}(x°)  . 

The  Chow-Krener  property  in  the  equilibrium  case  is  an  easy  consequence  of  these  characterizations. 
Note  that  the  conditions  in  this  Theorem  involve  iterated  compositions  of  transitions  corresponding 
to  only  one  control  -arbitrarily  taken  as  the  zero  control.  The  “naive”  conditions  that  one  can  give 
based  on  the  implicit  function  theorem  for  the  above  accessibility  properties  would  involve  compositions 
of  all  transition  mappings,  m  well  as,  for  forward-backward  accessibility,  of  their  (possibly  hard  to 
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compute)  inverses.  Moreover,  in  the  particular  case  when  the  system  has  for  instance  the  form  z(<  + 1)  = 
x(<)  4-  g{x{t),  u{t))  with  g{x,  0)  =  0,  the  “Ad’s"  become  all  the  identity  ^uld  no  compositions  at  all  need 
be  computed. 

The  above  Theorem  is  valid  in  the  global  sense  that  the  dimensions  of  these  spaces  being  equal  to 
n  (the  dimension  of  the  state  space)  at  every  point  is  equivalent  to  the  corresponding  property  holding 
from  every  state  x°.  But  the  pointwise  version  is  false,  for  nonequilibria.  Recent  work  with  our  student 
Albertini  has  shown  that  one  can  obtain  the  pointwise  version  in  the  case  of  systems  satisfying  certain 
stability  conditions;  see  [49],  [20]. 

6.2  A  Class  of  Hamiltonian  Systems 

As  emphcisized  in  much  recent  work,  it  is  often  very  useful  to  impose  additional  structure  on  the  system 
model  (1)  in  order  to  exploit  special  properties  of  mechanical  systems.  In  the  paper  [27]  the  PI  described 
a  clciss  of  Hamiltonian  systems  in  the  context  of  which  a  number  of  results  about  time-optimal  control 
can  be  obtained.  Using  this  aodomatic  class  (the  axioms  cem  be  typically  checked  for  mechanical  systems 
directly  from  first  principles),  and  the  relations  along  Lie  brackets  that  automatically  hild  there,  one 
may  derive  a  number  of  results  for  robotic  manipulators  which  previously  required  a  very  large  amount 
of  symbolic  computation.  The  main  results  characterized  regions  of  the  state  space  where  singular 
trajectories  cannot  exist,  and  provided  high-order  conditions  for  optimality.  This  work  was  motivated 
by  previous  studies  by  the  PI  (with  Sussmann)  done  specifically  for  robotic  manipulators. 

6.3  Input/Output  Equations 

The  work  in  this  area  was  carried  out  together  with  former  graduate  student  Y.  Wang.  The  topic  is  the 
relation  between  realizability  and  the  existence  of  “input  output  equations”  of  the  type 

E  . =  0  (7) 


M-)  =  (w(-)iJ/(-)) 

are  the  i/o  pairs  of  the  system.  This  r<*!ati<ui  is  ess-  ntial  iu  understanding  issues  of  identifiability.  and 
it  generalizes  to  noi/iiiear  systenui  t'  e  equivalence  between  autoregressive  representations  and  finite 
dimensional  linear  realizability.  The  work  resulted  in  a  feir-reaching  generalization  of  the  Pi’s  previous 
theory  for  polynomial  discrete-time  systems  covering  the  full  analogy  to  the  discrete  case  as  well  as 
results  that  are  stronger  than  in  that  case.  A  number  of  papers  have  been  written  (see  e.g.  [14],  [15], 
[29]). 

The  functional  relation  E  is  usu€dly  estimated,  for  instance  through  least  squares  techniques,  if  a 
parametric  general  form  is  chosen,  such  as  using  polynomials  of  a  fixed  degree.  For  .example,  in  linear 
systems  theory  one  often  deals  with  degree-one  polynomials  E: 

y(*)(t)  =  aiy(t)  -b  . . .  +  0)fcy<‘"*’(<)  +  f>Mt)  +  ■  -  •  +  (8) 

(or  their  frequency-domain  equivalent,  transfer  functions;  the  difference  equation  analogue  is  sometimes 
called  an  “autoregressive  moving  average”  representation).  In  the  linear  case,  such  representations  form 
the  basis  of  much  of  adaptive  control  and  identification  theory.  State-space  formalisms  are  more  useful 
than  i/o  equations  for  problems  in  nonlinear  control,  however.  Thus  a  basic  question  is  that  of  deciding 
when  a  given  i/o  operator  admits  a  state-sp^^ce  representation.  The  work  in  the  project  derilt  mostly 
with  those  systems  that  are  affine  in  controls  as  in  Equation  (2),  in  which  the  entries  of  /o  and  G,  as 
well  as  ein  output  function,  can  be  expressed  in  terms  of  rational  or  polynomial  functions  of  the  state. 

For  the  linear  case,  one  knows  that  an  equation  such  as  (8)  can  be  reduced,  by  adding  state  variables 
for  enough  derivatives  of  the  output  j/,  to  a  linear  time-invariant  system.  In  frequency-domain  terms, 
rationality  of  the  transfer  function  is  equivalent  to  realizability.  For  nonlinear  systems  this  reduction 
presents  a  far  harder  problem,  one  that  is  to  a  great  extent  unsolved.  The  problem  is  basically  that  of  in 


12 


some  8€n8e  replacing  a  nontrivial  equation  (7)  by  a  system  of  first-order  equations  which  does  not  involve 
derivatives  of  the  inputs.  (For  the  converse,  it  is  easy  to  show,  by  elementary  arguments  involving  finite 
transcendence  degree,  that  any  i/o  operator  realizable  by  a  rational  state  space  system  satisfies  some 
i/o  equation  of  type  (7),  with  E  a  polynomial.) 

The  paper  [15]  develops  many  basic  analytic  properties  of  Fliess  operators  used  in  establishing  the 
result  that  such  an  operator  satisfies  an  algebraic  i/o  equation  (i.e.,  all  pairs  (u,  F[u])  do)  if  and  only 
if  it  is  recdizable  by  a  singular  polynomial  system.  The  proofs  are  based  on  a  careful  analysis  of  the 
concept  of  observation  space,  introduced  by  Lo  in  the  mid-19708  -and  by  the  PI  for  discrete-time,-  and 
developed  further  by  Fliess,  Bartosiewicz,  and  others.  One  of  the  central  technical  results  relates  two 
different  definitions  of  this  space,  one  in  terms  of  smooth  controls  amd  another  in  terms  of  piecewise 
constant  ones;  these  two  definitions  are  seen  to  coincide  ([11]).  One  of  them  immediately  relates  to 
i/o  equations,  while  the  other  is  related  to  realizability  through  the  notions  of  observation  algebras  and 
observation  fieldss  which  are  the  natural  analogues  of  the  corresponding  discrete-time  concepts  studied 
earlier  and  were  introduced  for  differentitd  equations  by  Bcirtosiewicz. 

In  [15],  the  results  from  [14]  relating  algebraic  i/o  equations  to  internal  recilizability  are  comple¬ 
mented  with  a  result  relating  ancdytic  i/o  equations  and  local  internal  realizability.  To  do  this,  one  first 
constructs  a  ■“meromorphic”  realization  by  studying  the  properties  of  meromorphically  finitely  generated 
field  extensions,  and  then  imposes  similar  properties  on  the  observation  fields  already  introduced  in  the 
former  paper.  Finally,  by  a  perturbation  approach,  together  with  the  Fliess  Lie  rank  condition  for  real¬ 
izability,  one  concludes  that  around  each  point  there  is  local  analytic  realization.  That  paper  combines 
the  techniques  from  differentiaj  algebra  used  in  the  polynomial  case  with  techniques  from  differential 
geometry  (Lie  rank  finiteness). 

Work  in  progress,  to  be  reported  at  the  1991  Conference  on  Decision  cind  Control,  deals  with  the 
replacing  of  differential  algebraic  equations  by  integral  equations,  in  so  far  as  possible.  The  latter  are  far 
less  sensitive  to  noise  and  more  suitable  for  identification  algorithms  that  involve  prefiltering  (as  done 
in  the  linear  case).  In  the  linear  case,  differential  equations  aie  always  equivalent  to  integral  ones,  but 
that  is  seen  not  to  be  so  in  the  nonlinear  case. 

6.4  Sign-Linear  Systems 

Recent  work  with  graduate  student  R.  Schwarzscbild  has  dealt  with  the  basic  systems  theory  (control¬ 
lability,  observability,  realization)  of  systems  whose  underlying  dynamics  are  linear  but  for  which  only 
cert£un  limited  logical  observations  are  possible.  This  relates  to  questions  of  quantization  in  digital  con¬ 
trol.  as  well  as  the  general  cirea  of  the  interface  between  classical  (continuous-variable)  control  systems 
and  logical  devices.  In  the  particular  case  in  which  only  the  sign  of  the  output  can  be  observed,  a  fairly 
complete  theory  seems  to  result,  and  a  paper  is  in  preparation  on  that  topic.  That  paper  deals  with 
sign-linear  systems: 

x(t  -b  1)  [  or  x(t)  ]  =  4z(t)  -b  Bu(t),  y(t)  =  sign  (Cx) 

where  4  is  an  n  x  n  matrix,  S  is  n  x  m,  and  (7  is  1  x  n  (with  the  convention  that  stgnfO)  =  0,) 
and  associated  sign-linear  i/o  maps  of  the  type  y(t)  =  8ign(4iu(t  —  1)  -b  . .  .Aiu{0))  or  the  analogous 
continuous-time  maiw  (convolution  followed  by  sign).  One  may  also  consider  multivariable  outputs,  but 
the  statements  become  slightly  more  complicated. 

Such  systems,  which  can  be  seen  as  an  extreme  case  ( 1-bit)  of  the  systems  with  quantized  observations 
studied  in  much  recent  work  by  Delchfimps,  appear  in  a  variety  of  areas.  For  instance,  they  model  the 
situation  when  linear  systems  me  used  as  classifiers,  providing  a  recursive  vers’'.a  of  the  Widrow-type 
■‘adelines”  used  in  pattern  smalysis.  They  (and  similar  models  that  are  based  on  bilineM  systems)  also 
arise  in  relaxation  techniques  for  learning  finite  automata.  Finally,  such  systems  provide  a  natural  class 
of  nonsmooth  nonlinear  systems,  a  class  that  combines  logical  and  switching  devices  together  with  more 
classical  continuous  variables. 

The  results  that  have  been  obtained  parallel  those  known  for  standard  linear  systems,  but  with 
a  few,  perhapts  unexpected,  differences.  Some  of  the  results  are  as  follows:  (a)  Minimal-dimensional 
realizations  are  unique  up  to  a  change  of  variables  in  the  state  space  and  a  positive  rescaling  of  outputs. 
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(b)  Finite-dimen8ion^d  realizability  can  be  characterized  in  the  usufd  manner  tising  Hankel  matrices,  (c) 
If  a  realization  of  a  given  i/o  map  is  controllable  and  observable,  in  the  usucd  sense  of  control  theory, 
then  it  is  minimal.  Conversely,  a  minimal  realization  is  necessarily  final-state  observable  (that  is,  there 
is  a  control  allowing  for  determination  of  the  state  at  the  end  of  the  interval  of  application)  but.  in 
the  discrete-time  case,  minimal  realizations  may  not  be  observable.  (In  continuous-time,  final-state  and 
[initial-state-]  observability  coincide.) 

Because  of  the  possible  lack  of  observability  of  minimal  realizations,  for  some  discrete-time  sign-linear 
i/o  maps  it  is  the  Ccise  that  the  abstract  ■‘canonical"  realization  predicted  by  automata  theory  is  not  given 
by  a  sign-linear  system.  Some  preliminary  results  are  available  in  that  case,  which  can  be  sometimes 
easily  described  in  terms  of  combinations  of  finite  automata  and  linear  systems.  A  detailed  paper  has 
been  just  submitted  summarizing  results  obtained  to  date  ([21]). 
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